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(57) Abstract: A digital information processing including a model of a finite slate machine (FSM) receiving a plurality of FSM 
inputs and producing a plurality of FSM outputs is represented by a reduced-state trellis and where the FSM inputs are defined on 
a base closed set of symbols (42, 44, 46, 48, 50, 52, 54, 56, 58). A method for updating soft decision information on the FSM 
inputs into higher confidence information by a) inputting the soft decision information into a first index set, b) a forward recursion is 
processed on the input soft decision information based on the reduced-stale trellis representation to produce forward state metrics, c) 
a backward recursion is processed on the input soft decision information based on the reduced-state trellis representation to produce 
backward state metrics, and d) the forward metrics and the backward stale metrics are operated on to produce the higher confidence 
information. 
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METHOD FOR ITERATIVE AND NON-ITERATIVE DATA 
DETECTION USING REDUCED-STATE SOFT-INPUT/SOFT-OUTPUT 
ALGORITHMS FOR COMPLEXITY REDUCTION 

CROSS-REFERENCE TO RELATED APPLICATIONS 
Not applicable. 

STATEMENT AS TO RIGHTS TO INVENTIONS MADE UNDER 
FEDERALLY SPONSORED RESEARCH AND DEVELOPMENT 
This work was supported by a US Army SBIR contract issued by commander 

of the US Army CECOM, AMSEL-ACCC-A-CF/EW Intelligence Contract No. DAAB07- 

98-C-K004. 

BACKGROUND OF THE INVENTION 
Currently, there is great interest in soft-input/soft-output (SISO) algorithms 
due to the outstanding performance of iterative data detection. Like the Viterbi algorithm 
(VA), the SISO algorithm is derived for an embedded system that can be modeled as a finite 
state machine (FSM). However, instead of making hard decisions as does the VA, the SISO 
algorithm generates soft decisions, i.e., reliabihty measures, for the investigated data. A hard 
decision can be readily obtained by thresholding the soft information. The key notion carried 
with the soft information, also its main advantage over a hard decision, is that the soft 
information can be refined by some way (e.g., through iteration) to make a later hard decision 
more reliable. Thus, the SISO algorithm is especially well-suited for iterative data detection. 
Because of this advantage, SISO algorithms have been widely used in various application, 
such as decoding of (both serial and parallel) Turbo codes and other codes, near-capacity 
multi-user detection, near-optimal two-dimensional data detection, and the detection of TCM 

signals in fading channels. 

The biggest obstacle facing a practical implementation of the SISO algorithm 
is probably its complexity. The complexity of a SISO algorithm grows exponentially with 
the memory length of the FSM, e.g., the number of taps in an inter-symbol interference (ISI) 
channel or the constraint length of a convolutional code. It is not difficult to imagine how the 
complexity of such an algorithm can quickly overwhehn even the most advanced signal 
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processing hardware and software. For a fixed-interval Tninimum sequence metric (FI-MSM) 
SISO algorithm, its computational complexity is approximately twice that of the VA and the 
number of memory xmits required is proportional to the product of block length and the 
number of states of the FSM. For instance, when the FI-MSM algorithm is applied to a 10- 
5 tap ISI channel with QPSK signaling, its complexity is dominated by the nimiber of the states 
of the FSM, which is the order of the modulation scheme raised to an exponential equal the 
number of taps minus one (4^ = 262,144). This relatively simple example of a transmitter and 
channel thus presents an implementation nightmare, as the relevant signal processing system 
is asked to perform SISO computations based on 262,144 possible states, a task that is 
1 0 practically rnfeasible today for most applications. 



producing soft outputs based on soft inputs that offers a significant reduction in 
computational and memory complexity from the standard SISO algorithm but is still capable 
of excellent performance. 



According to the invention, in a digital information processing system wherein 
a model of a firute state machine (FSM) receiving a plurality of FSM inputs and producing a 
plurality of FSM outputs is represented by a reduced-state trelhs and wherein the FSM inputs 

20 are defined on a base closed set of symbols, a novel method is presented for updating soft 
decision information on the FSM inputs into higher confidence information whereby (1) the 
soft decision information is inputted in a first index set, (2) a forward recursion is processed 
on the input soft decision information based on the reduced-state trellis representation to 
produce forward state metrics, (3) a backward recursion is processed on the input soft 

25 decision information based on the reduced-state trellis representation to produce backward 

state metrics, wherein the backward recursion is independent of the forward recursion and (4) 
the forward state metrics and the backward state metrics are operated on to produce the 
higher confidence information. 

In one embodiment, an a-posteriori probability (APP) RS-SISO algorithm is 

30 used. In another embodiment, a minimum sequence metric (MSM) RS-SISO algorithm is 
used that is computationally simpler than the APP RS-SISO algorithm. 

Results of numerical simulations based on various contexts are also presented 
to illustrate the performance of the RS-SISO algorithm. 



Therefore, there is a need for a method of digital information processing for 
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This invention finds particular application in improvement in the complexity 
and accuracy of data detection in digital signal processing systems. The invention will be 
better understood by reference to the following detailed description in connection with the 
accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 shows a digital communication system employing a treUis coded 

modulation (TCM) encoder; 

Figure 2 shows a section of a trellis describing an FSM which models a 
process such as TCM encoding, ISI interference, and others; 

Figure 3 illustrates Ihe construction of the forward and backward transition 
and completion steps at time ^ in the RS-SISO algorithm; 

Figure 4 shows a RS-SISO module within an iterative detection network; 

Figure 5 A shows an ISI/AWGN channel used test the performance of various 

detectors; 

Figure 5B shows a detector representing two hard decision algorithms, the VA 

and DDFSE; 

Figure 5C shows a detector representing the MSM RS-SISO algorithm with 

self-iteration capability; 

Figure 6 illustrates the convergence properties of the detector shown in Figure 

5C in different ISI/AWGN channels; 

Figure 7 compares the performance of the MSM RS-SISO algorithm with 
other algorithms in a minimum phase ISI/AWGN channel; 

Figure 8 compares the performance of the MSM RS-SISO algorithm with 
other algorithms in non-minimum phase ISI/AWGN channels; 

Figure 9A shows a TCM/ISI/AWGN channel used test the performance of 

various detectors; 

Figure 9B shows the construction of a detector having the VA as both the 

inner and outer detector (VA - VA); 

Figure 9C shows the construction of a detector having an inner SISO module 

and an outer VA detector (MSM SISO - VA); 

Figure 9D shows the construction of a detector having an inner RS-SISO 
module and an outer SISO module and employing inner and outer iteration (MSM RS-SISO - 
SISO); and 
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Figure 10 shows the simulation results of the various detectors shown in 
Figures 9B-9D, along with other performance results. 

DESCRIPTION OF SPECIFIC EMBODIMENTS 
5 Figure 1 shows a digital communication system 10 employing a trellis coded 

modulation (TCM) encoder 14. Such a TCM encoder 14 is just one of the many processes 
that can be modeled as a finite state machine (FSM). Other such processes include, but are 
not limited to, encoders based on Turbo codes or other codes, near-capacity multi-user 
detection, near-optimal two-dimensional data detection, fading channels, and inter-symbol 
10 interference (ISI) channels. Referring to Figure 1, the digital communication system 10 
includes a data source 12 providing symbols defined on a particular closed set of symbols. 
For example, if a binary closed set of symbols is used, the symbols are selected fi-om {0, 1}. 
The symbols firom the data source 12 are transferred to the TCM encoder 14, which converts 
the symbols into encoded symbols according to the structure of the TCM encoder 14. The 
15 encoded symbols are then sent through a channel 1 6, which can add noise, such as additive 
white Gaussian noise (AWGN), and distortions to the encoded symbol to produce an 
observed signal. Soft information relating to the observed signal is sent to a TCM decoder 
18. The TCM decoder 18 outputs soft information regarding the symbols which can be 
thresholded to produce hard-decision decoded symbols. Since the operation of the TCM 
20 encoder 14 can be modeled as an FSM, the decoding function of tiie TCM decoder 18 can be 
based on the reduced-state soft-input/soft-output (RS-SISO) algorithm according to the 
invention as discussed below. 

The digital communication system shown in Figure 1 is a fimctional block 
diagram providing an illustrative example of basic functions. Different fimctions may be 
25 added or omitted. Also, appUcation of the innovative methods discussed herein is not limited 
to this specific block diagram. Similarly, otiier block diagrams discussed below are merely 
illustrative examples and do not limit the apphcabihty of the methods discussed herein. 

Figure 2 shows a section of a trelUs describing an FSM which models a 
process such as TCM encoding, ISI interference, and others. Here, the trellis is a state 
30 diagram with exphcit denotation of index in time, space, or some other dimension. 

Generally, such a trelhs consists of a set of states 5 = {iSi, iS'2, . . . , Sn} ■ The state of the FSM 
at time k is Sk = Si e S, The trelUs transition t is deterministically driven by a data source that 
outputs sequence {ax, 02, ... , ax} with symbol drawn from the M-ary closed set of 
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symbols A = {^o, • • • . ^m-i}- Therefore, in an FSM, each transition t is associated with a 
starting state /(O, an ending state s%t), an input symbol a(t) and a output symbol x(0. For 
simplicity of presentation, only the FSM whose state is defined assk = (flk-L. Ok-L+u ■ 
is discussed here. However, one skilled in the art would reaUze that such a restriction is not 
5 necessary to the functionality of the FSM and related operations. An FSM whose state is 
defined as Sk = (ajt-L, ak-i^i, • . • , at-i) is said to have memory length L and the number of 
states TV = Jl/. Consequently, for a transition tk =,{ak-L, Ok), the relevant expressions are: 

Atk) = (ak-L, . . • , ak-i), (tid = (flt-L-M ^k), a{tk) = flfo and the output symbol Xk = x{tk). 

The function can be any mapping, such as a 1-to-l mapping, an n-to-1 mapping, an n-to- 
10 m mapping, or some other mapping. 

For clarity of illustration, Figure 2 shows a section of a trellis for a relatively 
simple FSM with iV= 4 and M= 2. Thus, the trellis consists of a set of states iS = {0, 1, 2, 3} . 
The state of the FSM at time kissk = Si^ S. The treUis transition t is deterministically driven 
by a data source that outputs sequence {ai, aj, . . . , with symbol ak drawn firom the 2-ary 
1 5 closed set of symbols y4 = {0, 1 } . In other words, the symbols are binary. 

Besides the knowledge of the FSM structure, the SISO algorithm also requires 
some soft information as its mput. The soft input is tiie sequence of rehability measures of 
the input symbol ak and the output symbol Xk. The two main kinds of soft infomiation that 
are widely used are the probability distaibution, such as and P(j:a), and its negative-log 
20 domain counterpart, such as metric U.{ak) and metric M{xk). Note that the superscript i and o 
to be used with P( ) and M( ) denote "input" and "output", respectively. The resulting 
algorithms are referred to as the a-posteriori probabiUty (APP) algorithm and the minimum 
sequence metric (MSM) algoritiun, respectively; It is assumed that the knowledge of FSM 
structure and the a-priori soft information are perfectly known. 
25 The following describes illustrative examples of the reduced-state soft- 

input/soft output (RS-SISO) algoritiun. The RS-SISO algorithm achieves complexity 
reduction by a factor of , when compared to the standard SISO algoritiim. To implement 
the RS-SISO, the memory of the FSM is truncated and the corresponding ti-eUis is rebuilt. 
The truncated state at time k is defined by = {ak-^clk-^^\,■,'^k-\) > ^* where Xi < Z, and La = 
30 X- Xi . If JL, = L, then v;^ = Sk, and tiie RS-SISO algorithm becomes equivalent to the standard 
SISO algorithm. As in tiie SISO algorithm, the following state sets are defined: 

(I) (y) = {i :Vf-^Vj is an allowable forward transition} (1) 
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B (z) =:{j :V,<r- Vj is an allowable backward transition} (2) 
X(77t) = {/: Vjt+i = Vj, is consistent with ak =^Am } (3) 

Figixre 3 illustrates the construction of the forward and backward transition 
5 and completion steps at time A: in the RS-SISO algorithm. The truncated state at time k is 
= {^k-L, ^k~L,+\ ^/c-i) > illustrated as being concatenated with a forward truncated 

survivor path. The truncated state at time k+1 is v^^^ = {<3^-ij+i,«jfc-z,+2..",^fc} ' 

illustrated as being concatenated with a backward truncated survivor path. 

In one embodiment, an a-posteriori probability (APP) RS-SISO algorithm is 
10 used. Here, forward and backward recursions can be calculated using the foUowdng 
recursively-defined quantities: 

<^k(^)^Yji^ u)^k-i (f)rk J) (4) 
A(0=Eye^(oA.iO>L(^7) (5) 

15 

with initial values as Oo (0 = Pr(vo - V,*) and PkW = Pr(vfc = V/). For example, at time k = 0, 
if the initial state of the FSM is Vj, then ao(/) = 1, ao(/') = 0,^ I If no knowledge about vo is 

available, then cxo(0 = M'^ . 

Residual state information may be used in the forward and backward 

20 recursions in (4) and (5) by including information on forward and backward truncated 

survivor paths. Associated with each truncated state Vk = Vi, a truncated survivor path in the 
forward recursion can be obtained as a( (z) = {5*_^ (z), a^A+i (0 ' ' ^t^-i ' ^ backward 
truncated survivor path can be obtained as a^.(0= {aUO ^^Liil'-^^Li^^ii})} (see Figure 3). 
One reasonable way to obtain these truncated survivor paths is by defining, for a state at time 

25 k, the forward (or baclcward) survivor state as the state contributing most in the summation of 
(4) or (5). Other reasonable ways of obtaining truncated survivor path are also applicable. 
Based on the truncated survivor paths, the quantities associated with tkiij) = (vk — Vi, ^k+i = 
Vj) in both the forward and backward recursion can be defined as (see Figure 3): 
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riiiJ) = ^'[^,..L.-^MiJl aL(7))]P'[«.(^,7)] (7) 

where ak(i,j) is the value of the input symbol associated with a forward transition Vi -*Vj. 
When L2 = 0, // (i, j) = rl (h J) » yielding the standard APP algorithm. 

5 Note that each element of a( (i) and (0 is defmed on the M-ary closed set 

of symbols A = {Ao, Ai, . . . , Am-i}- Alternatively, each element of a{ (0 and 5^(0 can be 
defined on some set partitioning of the M-ary closed set of symbols A = {Aq, A\, . . . , Am-i}- 

For example, ifM= 8 and^ = {Ao,Ai A7}, elements of a{(0 and 5^(0 maybe defined 

on the set partitioniag D = {Do, I>i}, where Do encompasses {^0, Ai, . . . , A3) and Di 

10 encompasses {A^, As,..-, A?} . Other types of set partitioning are also possible. 

The complexity of the forward and baclcward recursion in (4) and (5) is 
primarily detfermined by the number of states, i.e., . Compared to the standard APP- 
SISO algorithm, the complexity of proposed APP RS-SISO is reduced by times. As 
illustrative examples, two types of soft output can be obtained as: 

15 

ria, =4J = ZyeC(„o«^^0-)A-0') (8) 

= An) =^P''(«* = 4J/P"K = An) (9) 

where c is a normalization constant. Due to the tmncation of states, cannot be 

20 yielded directly as in the standard SISO algorithm. However, P" {x,) can still be obtained 
approximately. One simple way is to use the following definition: 

^:(x,=xiO)=Y]',^^_^TM'.t,) (10) 

25 which can work fairly well. It is notable that (1 0) can be calculated recursively due to the 
temporal relationship between 4- and 4+;- K (') ^^n be viewed as the (approximate) a- 
posteriori probability normalized to the a-priori probabiUty and is usually referred to as 
"extrinsic" information. If fiuther iteration is necessary, P;(0 can be used as feedback. 
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Otherwise, the hard decision may be made by the rale: a^^ = if F"" (a^^ ^ A^) > 

P'^Ca^ = Aj) for all 0 <j < M- 1, The completion step in (8) is also illustrated in Figure 3. 

The data detection performance of the RS-SISO algorithm is suboptimal when 
compared to the SISO algoritlim, which is more complex in computation and memory. It can 
be observed that when the RS-SISO algorithm generates the soft output for ak, the input 
infomiation in time interval [A: + 1, A: has not been used. This further degrades 
performance. Self-iteration can be used to improve the performance of the RS-SISO 
algorithm. By feeding its soft-output back to its own soft-input port several times, the RS- 
SISO can fiise the information in the time interval {k^l,k +L2] into the final soft output for 
flk. Self-iteration can thus improve performance significantly. 

The quantities aK and Pk are examples of forward state metrics and backward 
state metrics, respectively. Alternatively, the APP RS-SISO algorithm can be based on 
forward transition metrics and backward transition metrics, in addition to forward state 
metrics and backward state metrics. Furthermore, the operations used to obtain soft output 
information need not be limited to summation and multiplication, which is shown in (8) of 
the example discussed above. Such operations may also include summation, multipHcation, 
minimum, maximum, minimum*, where minimimi* (x, y) = miriunimi(x, y) - hi(l+e''''"^'), 
maximum*, where maximum* (x, y) = maximum(x, y) - hi(l+e'''''^'), linear weighting, 
exponentiation, combinations of the above, or others. 

In another embodiment, a minimum sequence metric (MSM) RS-SISO 
algorithm is used. As m the APP RS-SISO algorithm, residual state information may be used 
in forward and backward recursions by including information on forward and backward 
truncated survivor paths. For example, in the case of an additive white Gaussian noise 
(AWGN), the negative-log domain counterparts to (6) and (7) can be defined as: 

A( {U j) = M'- [x, = x(af (0, h (h 7))] + M'- [a, {U j)] d D 

Jlt{iJ)^yv[x,,^ =^(^,(z\y).at,a))] + M^ [a,{ij)] (12) 

respectively, where the metric M(w) = -ln(P(w)). 

Note that each element of a{ (z) and a* (f) is defined on the Af-ary closed set 

of symbols yd = {^0,^1, • • . Alternatively, each element of a;^(0 and a^(z) can be 
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10 



15 



20 



defined on some set partitioning of the M-ary closed set of symbols A - {Aq, Ax,..., Ama } . 
For example, if M = 8 and^ = {^o, Ax,..., A?}, elements of a{(0 and at(f) maybe defined 
on the set partitioning D = {Do, Di}, where Do encompasses {^o, Ai, . . . , As} and Di 
encompasses {A^, As,..., A?}. Other types of set partitioning are also possible. 

The sequence metric associated with a symbol sequence a^J.^, , or the 

equivalent state sequence v^*^ can be defined as: 

A'(vr) = ZL,A'0-.7) 
and the key quantities for MSM RS-SISO are defined as: 

^,0-) = imn...,^,=.,A^(vr) (15) 
7,(0 = mni^K., _^.A^(vL) (16) 

consequently, the forward and backward recursion and the completion step of MSM RS- 
SISO can be expressed as: 

= min,^ [^.(0 + (17) 

W(a, = AJ = min,,c(«) [W) + %U)] (19) 
Ulia, = AJ = M\a, =AJ- Uia, = A„) (2^) 
U:(ix,=x(t,))=^^l,_^U:iar-h) (21) 

25 Since the forward and backward reciH'sion are similar to the recursion in the 

VA, the MSM RS-SISO can obtain the survivor paths used in (10) and (11) just as in the VA. 
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Again, M°() is fed back if fiirther iterations are needed, and WM is used to make the 
hard decision by the rule: a, = 4,. if M'ia, = A„,)<M''(a, A.) for aU 0^7<M-1. 

Compared to the APP version, the MSM version only involves summation and 
comparison operations. Computationally, it is simpler than the APP version. However, the 
way the survivor path is defined in a log-APP algorithm must be specified (i.e., as discussed 
above). Numerical experiments have shown that the MSM SISO algorithm performs almost 
as well as its APP counterpart. Similarly, compared to the standard MSM algorithm, the 
complexity of MSM RS-SISO is also reduced by times. 

The quantities and are examples of forward state metrics and backward 

state metrics, respectively. Altematively, the MSM RS-SISO algorithm can be based on 
forward transition metrics and backward transition metrics, in addition to forward state 
metrics and backward state metrics. Furthermore, the operations used to obtain soft output 
information need not be limited to minimum and summation, as is shown in (19) of the 
example discussed above. Such operations may also include summation, multipUcation, 
minimum, maximum, minimum*, where minimum* (x, y) = minimum(x, y) - hi(l+e-'*-y'), 
maximum*, where maximum* (x, y) = maximum(x, y) - hi(l+e-'*'^')= linear weighting, 
exponentiation, combinations of the above, or others. 

Figure 4 shows a RS-SISO module withm an iterative detection network. An 
example of an iterative detection network 40 is shown. Here, a data source 42 is connected to 
a TCM encoder 44, which is connected to an interieaver 46, which is connected to an ISI 
channel 48. The output of the ISI channel is sent to the channel 50, where AWGN noise 
and/or distortion may be added. Although pictured separately, the ISI channel 48 maybe a 
part of the channel 50. An iterative detection network 40 consisting of SISO modules and 
soft information exchange rules and schedules receives the output of tlie channel 50. The 
iterative detection network 40 contains an ISI RS-SISO module 52 that has replaced a 
conventional ISI SISO module. It also contains an interieaver/deinterieaver 54 and a TCM 
SISO module 56. Soft information is chculated inside iterative detection network 40 several 
times before output is sent to a thresholder 58, where a hard decisions are made. Usually, the 
maximum number of iteration required to achieve a certain level of performance can be 
estimated numerically. For / iterations, the complexity of an iterative detection network 
employing a conventional SISO module, such as the conventional ISI SISO that has been 
replaced here, is proportional to /M^ . Tlie RS-SISO algorithm is especially well-suited for 
use in an iterative detection network. By replacing the standard SISO module with an RS- 
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SISO module, such as the ISI RS-SISO module 52, the complexity of the iterative detection 
network employing tiie RS-SISO algorithm is reduced by a factor of JM^ . 

The following describes results of numerical simulations performed to test the 
performance of the RS-SISO algorithm. 
5 Figure 5 A shows an intersymbol interference, additive white Gaussian noise 

(ISI/AWGN) channel used to test the performance of various detectors. The structure of the 
ISI/AWGN channel is represented as a 12-tap (L = 11) ISI block, along with components for 
adding AWGN. As to the taps of the ISI block, which is an FSM, Channel A has equal 
entries and Channel B has taps selected to be (c, 2c • • • , 12c) . Both channels are normalized to 

10 have unit power. The transmitter uses a BPSK signaUng scheme (i.e., = ±y[E^ ). The 

output of the ISI channel is then corrupted by an AWGN with E{nl} = NJ2. Figure 5B 
shows a detector representing two hard decision algorithms, the VA and the delayed decision- 
feedback sequence estimation O^DFSE) algorithm, that are tested for purposes of 
comparison. Similar to the RS-SISO, truncated state of length Li is defined in the DDFSE. 

1 5 Figure 5C shows a detector representmg the MSM RS-SISO algorithm with self-iteration 
capabiUty. 

Figure 6 illustrates the convergence properties of the detector shown in Figure 
5C in different ISI/AWGN channels. The performance results shown here and below are 
obtained by numerical simulation. As seen in Figure 6, convergence occurs after 4-5 
20 iterations. 

Figure 7 compares the performance of the MSM RS-SISO algorithm with 
other algorithms in a minimum phase ISI/AWGN channel. An index of the computational 
complexity of the algorithm is defined as the product of the number of transitions M^*^ , the 
self-iteration number / and the recursion number r. Since the VA is forward-only, it has r = 

25 1. By contrast, the forward/baclcward SISO has r = 2. In Figures 7, as well as in Figures 8 
and 9, this complexity index is shown for each algorithm used. The performance of the VA 
with 2^^ = 2,048 states is presented as a baseline. First, it is noted that the DDFSE performs 
roughly 3 dB worse than the VA at a bit error rate (BER) of 10"^ when Li = 5, i.e., the 
DDFSE uses 2^ = 32 states. Without self-iteration, the MSM RS-SISO with Li = 2 performs 

30 only 0.3 dB better than the DDFSE. However, if self-iteration is used, after only 4 iterations, 
the performance of MSM RS-SISO is improved by 1.9 dB, and is only 0.8 dB away firom that 
of the VA. The complexity index indicates that the RS-SISO is 64 times simpler than the VA 
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with aperfoimance degradation of less than 1 dB while it outperfonns aDDFSE of similar 

complexity by 2.2 dB. 

Figure 8 compares the performance of the MSM RS-SISO algorithm with 
other algorithms in non-minimum phase ISI/AWGN channels. Due to the bi-directional 

5 recursion of the RS-SISO algorithm (forward and backward recursions), its robustness to 
non-minimum phase channels is expected. By contrast, the DDFSE's non-symmetric 
structure (only a forward recxirsion is used) degrades its performance greatly when the 
channel is non-minimum phase. Channel B is such a channel, with taps of its ISI block 
selected to be (c, 2c • • • , 12c) . Channel B' is defined as the time-reversed version of Channel 

10 B, that is, (12c,l Ic- • • , c) . The simulation results in Figure 8 clearly show that the DDFSE 
with Li=5 virtually fails for Channel B but works well for Channel B'. However, the 
iterative detector based on RS-SISO with the same complexity (Zi = 2 and / = 4) performs 
nearly optimally for both Channels B and B'. 

Figure 9A shows a trelUs code modulation, intersymbol interference, additive 

1 5 white Gaussian noise (TCM/ISI/AWGN) channel used to test the performance of various 

detectors. An 8-state, rate R = 2/3 Ungerboeck 8-PSK TCM code is used in this test. The 8- 
PSK signals from the TCM encoder are fed into a 32x32 block interleaver. The interleaved 
8-PSK signals pass through a 5-tap (X = 4) ISI channel with equal entries (normalized to unit 
power), and the ou^ut is corrupted by a white complex circular Gaussian noise nk Avith 

20 E{\n,f} = NJ2. 

Figures 9B-9D show various detectors tested using the signal generated by the 
system shown in Figure 9A. It is too complex to build a Viterbi detector by considering the 
concatenated TCM encoder and ISI channel as a single FSM. Alternatively, an iterative 
detection network may be used. That is, an effective approach is to build a "detector" (hard 

25 or soft) for each subsystem separately, such as an inner and an outer detector, and allow 
information to be processed iteratively and passed between the inner and the outer detector. 
Figure 9B shows the contraction of a detector having the VA as both the inner and outer 
detector (VA - VA). One can use the VA as both the inner and outer detector, but poor 
perfonnance is expected because the TCM code is decoded with hard decisions. Figure 9C 

30 shows the construction of a detector having an inner SISO module and an outer VA detector 
(MSM SISO - VA). Here, the inner VA detector has been replaced by the SISO module, 
which can improve the overall performance since more reliable Euclidean distance is used at 
the outer VA detector. 
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Furthermore, by replacing the outer VA detector by a SISO module and using 
iterative detection, the overall performance can approach that of the optimal performance. 
However, even by treating the subsystems separately, the complexity of the inner detector is 
prohibitive. For example, in the above system, the inner FSM has 8^ = 4,096 states and 8^ = 
32,768 transitions. 

Figure 9D shows the construction of a detector having an inner RS-SISO 
module and an outer SISO module and employing inner and outer iteration (MSM RS-SISO - 
SISO). Due to the sub-optimality of the RS-SISO algorithm and the concatenated detection 
structure, both the self-iteration of the inner RS-SISO module (also called inner iteration) and 
the outer iteration are used to increase the effectiveness of the detector. Therefore, besides 
the number of outer iterations h associated with general iterative schemes, there is another 
design parameter for this specific detector: the number of the inner iterations If. Before 
feeding the soft information on the 8-PSK symbols to the outer SISO, the inner RS-SISO may 
conduct several inner iterations to improve the quality of the soft output. In this case, the 
complexity index is redefined as M^^^IJiV . 

Figure 1 0 shows the simulation results of the various detectors shown in 
Figures 9B-9D, along with other performance results. There is a 5 dB gain mEjN^aX^ 
BER of lO"' by replacing the VA with a MSM-SISO at the inner stage. This can be seen by 
comparing the results for MSM SISO - VA against the result for VA - VA. When replacing 
the inner VA by a MSM RS-SISO with = 2 (/,• = 1), a 0.3 dB gain is obtained. This can be 
seen by comparing the results for MSM RS-SISO - VA against the results for VA - VA. In 
other words, without any performance degradation, the detector complexity is reduced by 32 
times by simply using an RS-SISO algorithm, without iterative detection. 

Performance detectors that combine the RS-SISO algorithm with iterative 
detection is also illustrated. As a baseline, it is shown that there is a 5 dB gain in / at a 
BER of 10-^ by replacing the VA with a MSM-SISO at the inner stage. This can be seen by 
comparing the results for MSM SISO - VA against the result for VA - VA. However, the 
complexity of the MSM SISO -VA scheme is prohibitive, as discussed above. By employing 
the RS-SISO algorithm together with iterative detection, complexity can be significantly 
reduced. Two such detectors, labeled as MSM RS-PISO - SISO, are tested. Both converge 
in only 4-5 iterations (results are not shown here). One detector uses an MSM RS-SISO with 
Li = 1 (8 states), and 3 inner iterations (/,• = 3). The hard decisions are made after five outer 
iterations (/„ = 5). Compared to the MSM SISO - VA scheme, the performance degradation 
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is only 1 . 1 dB while the complexity saving is 34 times. In order to obtain better performance, 
the other detector uses ii = 2 and 7, = 3. After four outer iterations (lo = 4), a 03 dB gain is 
obtained over the MSM SISO - VA scheme while the complexity saving is roughly 5 times. 
Note that in this appUcation, any reduced complexity hard-decision processor (e.g., RSSE, 
5 DDFSE) will perform worse than the VA - VA scheme in Figure 10. 

Thus, simulation results show that the RS-SISO algorithm provides signiJBcant 
reductions to complexity in very practical systems. The RS-SISO algorithm can be used in 
conjimction with iterative detection, including self-iteration, to provide additional reductions 
to complexity. Moreover, The results show that favorable tradeoffs between complexity and 
10 performance can be obtained by varyiag readily adjustable parameters within the algorithm. 

The invention has been explained with reference to specific embodiments. 
Other embodiments will be evident to those of ordinary skill in the art. It is therefore not 
intended that this invention be Umited, except as indicated by the appended claims. 
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WHAT IS CI AIMED IS: 

1 1 . In a digital information processing system wherein a model of a finite 

2 state machine (FSM) receives a plurality of FSM inputs and produces a plurahty of FSM 

3 outputs, a method for updating soft decision information on said FSM input symbols into 

4 higher confidence information, the method comprising: 

5 (a) inputting said soft decision information in a first index set; 

6 (b) combining said input soft decision information with knowledge regarding 

7 said finite state machine; 

8 (c) outputting said higher confidence information; 

9 (d) modifying said input soft decision information using said output higher 

1 0 confidence information via a feedback path; and 

1 1 (e) repeating steps (a) to (d) until a termination condition is met. 

1 2. In a digital information processing system wherein a model of a finite 

2 state machine (FSM) receiving a plurahty of FSM inputs and producing a plurahty of FSM 

3 outputs is represented by a reduced-state treUis and wherein said FSM inputs are defined on a 

4 base closed set of symbols, a method for updating soft decision information on said FSM 

5 inputs into higher confidence information, the method comprising: 

6 (a) inputting said soft decision information in a first index set; 

7 (b) processing a forward recursion on said input soft decision mformation 

8 based on said reduced-state treUis representation to produce forward state metrics; 

9 (c) processing a backward recursion on said mput soft decision information 

1 0 based on said reduced-state ti-elUs representation to produce backward state metrics, wherein 

1 1 said backward recursion is independent of said forward recursion; 

12 (d) operating on said forward state metiics and said backward state metrics to 

1 3 produce said higher confidence information; and 

1 4 (e) outputting said higher confidence information. 

1 3 . The method of claim 2, fiirther comprising tiie steps of: 

2 (f) modifying said input soft decision information using said output higher 

3 confidence information via a feedback path; and 

4 (g) repeating steps (a) to (f) until a termination condition is met. 
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1 4. The method of claim 2, wherein said operating comprises at least one 

2 of the following operations: summing, multiplication, minimum, maximum, rniiiimum*, 

3 maximum*, linear weighting and exponentiation. 

1 5 . The method of claim 2, wherein the step of forward recursion 

2 processing includes the steps of: 

3 using residual state information to augment reduced-state trelhs information to 

4 produce said forward state metrics; and 

5 updating said residual state information. 

1 6. The method of claim 2, wherein the step of backward recursion 

2 processing includes the steps of: 

3 using residual state information to augment reduced-state trelhs information to 

4 produce said backward state metrics; and 

5 updating said residual state information. 

1 7. The method of claim 5, wherein said residual state information is a 

2 plurality of decisions on said FSM inputs. 

1 8. The method of claim 6, wherein said residual state information is a 

2 plurality of decisions on said FSM inputs. 

1 9. The method of claim 7, wherein said decisions on said FSM inputs are 

2 defined on a revised closed set of symbols, wherein said revised closed set of symbols is a 

3 partitioning of said base closed set of symbols. 

1 10. The method of claim 8, wherein said decisions on said FSM inputs are 

2 defined on a revised closed set of symbols, wherein said revised closed set of symbols is a 

3 partitioning of said base closed set of symbols. 

1 1 L The method of claim 2, wherein the digital information processing 

2 system is operative to perform at least one of the following functions: 

3 iterative detection; 

4 iterative decoding; 

5 turbo detection; 

6 turbo decoding; 

16 
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7 message passing; and 

8 belief propagation. 

1 12. The method of claim 2, wherein said finite state machine is operative 

2 to model at least one of the following: 

3 a communication medium; 

4 a storage medium; and 

5 an imaging medium. 

1 13. The method of claim 2, wherein said finite state machine is operative 

2 to model at least one of the following: 

3 allowable input and output pairs of a forward error correction code; and 

4 a forward error correction encoder. 

1 14. The method of claim 2, wherein said finite state machine is operable to 

2 model a composite signal comprising at least one desked signal and at least one interference 

3 signal. 

1 1 5 . In a digital information processing system wherein a model of a finite 

2 state machine (FSM) receiving a plurality of FSM inputs and producing a plurality of FSM 

3 outputs is represented by a reduced-state t-eUis and wherein said FSM inputs are defined on a 

4 base closed set of symbols, a metiiod for updating soft decision information on said FSM 

5 inputs into higher confidence information, the metiiod comprising: 

6 (a) inputting said soft decision information in a first index set; 

7 (b) processing a forward recursion on said input soft decision information 

8 based on said reduced-state treUis representation to produce forward state metrics and 

9 forward transition metrics; 

10 (c) processing a baclcward recursion on said input soft decision information 

1 1 based on said reduced-state tieUis representation to produce backward state metiics and 

1 2 backward transition metiics, wherein said backward recursion is independent of said forward 

13 recursion; 

[4 (d) operating on said forward state metiics, said forward state tiansition 

1 5 metiics, said backward state metiics and said backward state tiansition metrics to produce 

16 said higher confidence information; and 

1 7 (e) outputting said higher confidence information. 
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1 16. The method of claim 15, further comprising the steps of: 

2 (f) modifying said input soft decision infomiation using said output higher 

3 confidence information via a feedback path; and 

4 (g) repeating steps (a) to (f) until a termination condition is met. 

1 17. The method of claim 15, wherein said operating comprises at least one 

2 of the following operations: summing, multipUcation, minimum, maximum, minimum*, 

3 maximimi*, linear weighting and exponentiation. 

1 18. The method of claim 1 5 , wherein the step of forward recursion 

2 processing includes the steps of: 

3 using residual state infomiation to augment reduced-state trellis information to 

4 produce said forward state metrics; and 

5 updating said residual state infomiation. 

1 19. The method of claim 15, wherein the step of backward recursion 

2 processing includes the steps of: 

3 using residual state information to augment reduced-state trellis information to 

4 produce said backward state metrics; and 

5 updating said residual state information. 

1 20. The method of claim 1 8, wherein said residual state information is a 

2 plurality of decisions on said FSM inputs. 

1 21. The method of claim 1 9, wherein said residual state information is a 

2 plurality of decisions on said FSM inputs. 

1 22. The method of claim 20, wherein said decisions on said FSM inputs 

2 are defined on a revised closed set of symbols, wherein said revised closed set of symbols is a 

3 partitiordng of said base closed set of symbols. 

1 23. The method of claim 21, wherein said decisions on said FSM inputs 

2 are defined on a revised closed set of symbols, wherein said revised closed set of symbols is a 

3 partitioning of said base closed set of symbols. 
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1 24. The method of claim 15, wherein the digital information processing 

2 system is operative to perform at least one of the following functions: 

3 iterative detection; 

4 iterative decoding; 

5 turbo detection; 

6 turbo decoding; 

7 message passing; and 

8 belief propagation. 

1 25. The method of claim 15, wherein said finite state machine is operative 

2 to model at least one of the following: 

3 a conununication medium; 

4 a storage medium; and 

5 an imaging medium. 

1 26. The method of claim* 15, wherein said jinite state machine is operative 

2 to model at least one of the following: 

3 allowable input and output pairs of a forward error correction code; and 

4 a forward error correction encoder. 

1 27. The method of claim 15, wherein said finite state machine is operable 

2 to model a composite signal comprising at least one desired signal and at least one 

3 interference signal, 

1 28 . The method of claim 1 5 , wherein the digital mformation processing 

2 system is a system performing iterative detection, iterative decoding, turbo detection, turbo 

3 decoding, message passing, or beUef propagation. 

1 29. A digital information processing system for updating soft decision 

2 infomiation into higher confidence information by representing a model of a finite state 

3 machine (FSM) receiving a plurality of FSM uiputs and producing a plurality of FSM outputs 

4 as a reduced-state trelhs, wherein said FSM inputs are defined on a base closed set of 

5 symbols, the system comprising: 

6 means for inputting said soft decision information in a first index set; 
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7 means for processing a forward recursion on said input soft decision 

8 information based on said reduced-state trellis representation to produce forward state 

9 metrics; 

10 means for processing a backward recursion on said input soft decision 

1 1 information based on said reduced-state trellis representation to produce backward state 

12 metrics, wherein said backward recursion is independent of said forward recursion; 

13 means for operating on said forward state metrics and said backward state 

14 metrics to produce said higher confidence information; and 

1 5 means for outputting said higher confidence information. 

1 30. A digital inforaiation processing system for updating soft decision 

2 information into higher confidence information by representing a model of a finite state 

3 machine (FSM) receiving a plurahty of FSM inputs and producing a pluraUty of FSM outputs 

4 as a reduced-state trellis, wherein said FSM inputs are defined on a base closed set of 

5 symbols, the system comprising: 

6 means for inputting said soft decision information in a first index set; 

7 means for processing a forward recursion on said input soft decision 

8 information based on said reduced-state trellis representation to produce forward state metrics 

9 and forward state transition metrics; 

10 means for processing a backward recursion on said input soft decision 

1 1 inforaiation based on said reduced-state trellis representation to produce backward state 

12 metrics and backward state transition metrics, wherein said backward recursion is 

1 3 independent of said forward recursion; 

14 means for operating on said forward state metrics, said forward state transition 

15 metrics, said backward state metrics and said baclcward state transition metrics to produce 

16 said higher confidence information; and 

17 means for outputting said higher confidence information. 

1 3 1 . A digital information processing device for updating soft decision 

2 information into higher confidence information by representing a model of a finite state 

3 machine (FSM) receiving a plurahty of FSM inputs and producing a plurahty of FSM outputs 

4 as a reduced-state treUis, wherein said FSM inputs are defined on a base closed set of 

5 symbols, the device comprising: 
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6 a plurality of device inputs for inputting said soft decision information in a 

7 first index set; 

8 a plurality of processing vmits for processing a forward recursion on said input 

9 soft decision information based on said reduced-state trellis representation to produce 

1 0 forward state metrics, processing a backward recursion on said input soft decision 

1 1 information based on said reduced-state trellis representation to produce backward state 

12 metiics, wherein said backward recursion is independent of said forward recursion, and 

1 3 operating on said forward state metrics and said backward state metrics to produce said 

14 higher confidence information; and 

15 a plurality of device outputs for outputting said highra: confidence information. 

1 32. A digital information processing device for updating soft decision 

2 infonnation into higher confidence information by representing a model of a finite state 

3 machine (FSM) receiving a plurahty of FSM mputs and producing a plurality of FSM outputs 

4 as a reduced-state treUis, wherein said FSM inputs are defined on a base closed set of 

5 symbols, the device comprising: 

6 a plurahty of device inputs for inputting said soft decision information in a 

7 first index set; 

8 a plurality of processing imits for processing a forward recursion on said input 

9 soft decision information based on said reduced-state trellis representation to produce 

1 0 forward state metrics and forward state transition metrics, processing a backward recursion 

1 1 on said input soft decision information based on said reduced-state trellis representation to 

1 2 produce backward state metrics and backward state transition metrics, wherein said backward 

1 3 recursion is independent of said forward recursion, and operating on said forward state 

1 4 metiics, said forward state ti-ansition metiics, said backward state metiics and said backward 

1 5 state ti-ansition metrics to produce said higher confidence information; and 

15 a plurality of device outputs for outputting said higher confidence information. 

17 
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